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Objective Visual search is an important attention process that precedes the information processing. Visual search also mediates the 
relationship between cognition function (attention) and social cognition (such as facial expression identification). However, the associa- 
tion between visual attention and social cognition in patients with schizophrenia remains unknown. The purposes of this study were to 
examine the differences in visual search performance and facial expression identification between patients with schizophrenia and nor- 
mal controls, and to explore the relationship between visual search performance and facial expression identification in patients with 
schizophrenia. 

Methods Fourteen patients with schizophrenia (mean age=46.36±6.74) and 15 normal controls (mean age=40.87±9.33) participated 
this study. The visual search task, including feature search and conjunction search, and Japanese and Caucasian Facial Expression of Emo- 
tion were administered. 

Results Patients with schizophrenia had worse visual search performance both in feature search and conjunction search than normal 
controls, as well as had worse facial expression identification, especially in surprised and sadness. In addition, there were negative asso- 
ciations between visual search performance and facial expression identification in patients with schizophrenia, especially in surprised 
and sadness. However, this phenomenon was not showed in normal controls. 

Conclusion Patients with schizophrenia who had visual search deficits had the impairment on facial expression identification. In- 
creasing ability of visual search and facial expression identification may improve their social function and interpersonal relationship. 
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INTRODUCTION 

Previous studies have extensively verified cognition func- 
tion impairment in patients with schizophrenia. 1 3 Cognition 
function impairment was found on not only executive func- 
tion, verbal fluency, process speed, visual attention, but also so- 
cial cognition. 4 7 According to the information-processing the- 
ory 8 and the feature -integration theory, 9 visual attention is the 
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first step of information process, which means our gaze rapid- 
ly towards objects in our visual environment field, through bot- 
tom-up and top-down process integrate the visual informa- 
tion. 10 It includes two core components: 1) feature search: the 
functioning of the preattentive and parallel process, partici- 
pants are required to search a target item among a number of 
non-target items (e.g., color); and 2) conjunction search: the 
functioning of the focal attention and serial process, partici- 
pants are required to search a target item among a number of 
non-target items with two type of distractors (e.g., color and 
display size). 11 13 The deficits of visual attention indicated as 
the endure elements across the lifetime of schizophrenia. 9 

Visual search deficit is considered a core symptom of visual 
attention impairment that interrupts cognition process and 
social cognition in patients with schizophrenia. 14 Tanaka et al. 3 
explored the detection and recognition of visual search per- 



Copyright €> 2013 Korean Neuropsychiatry Association 393 



Visual Attention, Facial Expression Identification 



formance between patients with schizophrenia and normal 
controls. The results showed that there was no group difference 
in feature search; however, conjunction search deficit was fo- 
und in patients with schizophrenia. 3 Less efficient on visual 
search task was a deficit in perceptual organization. 15 However, 
Tanaka et al. 3 did not examine the relationship between the vi- 
sual search performance and social cognition. 

Social cognition can be understood as "the mental opera- 
tions underlying social interactions, which include the human 
ability to perceive the intentions and dispositions of others". 16 
Facial expression identification is one of social cognition abili- 
ty which includes decoding, encoding, and subjective reac- 
tions of facial expressions of emotions. 17 Kerr and Neale 18 fo- 
und that patients with schizophrenia had worse emotion re- 
cognition than normal controls. Addington and Addington 19 
found that patients with schizophrenia performed poorly on 
facial affect recognition and facial recognition than bipolar 
patients and normal controls. 

Visual attention is an early-stage of visual processing which 
through bottom-up approach related to emotion recognition. 20 
Kalkstein et al. 21 demonstrated the facial expression and rec- 
ognition deficits in patients with schizophrenia. Deficits emo- 
tion identification was associated with impaired the magno- 
cellular-basis visual sensory processing. 20 The visual attention 
deficits may associate with facial affect recognition deficits. 19 

What is the role of visual attention in facial expression iden- 
tification? A visual attention deficit may influence information 
processing and cause cognition deficit, and may even result 
in poor social cognition. 22 Social cognition is mediated by cog- 
nition function (e.g., attention, memory, executive function) 
which influences the outcome of social function (e.g., social 
relationship and social skill). 23 However, there are few studies 
that have linked visual search performance and facial expres- 
sion identification in patients with schizophrenia. 



nia and normal controls; 2) to examine the differences in facial 
expression identification between patients with schizophre- 
nia and normal controls; and 3) to explore the relationship be- 
tween cognition (visual search performance) and social cog- 
nition (facial expression identification). 

METHODS 
Participants 

Fourteen patients with schizophrenia (mean age=46.36± 
6.74; 8 male and 6 female) and fifteen normal controls (mean 
age=40.87±9.33; 4 male and 11 female) participated in this 
study. Patients with schizophrenia were diagnosed by psychi- 
atrists based on the criteria of Diagnostic and Statistical Man- 
ual of Mental Disorders-IV-TR (DSM-IV-TR). 24 Fifteen pa- 
tients with schizophrenia were recruited from the Shin -Ann 
Hospital, one were being excluded due to interrupt by psychi- 
atric symptoms and cannot follow the experimental proce- 
dure. Normal controls were health population who were re- 
cruited form community. 

All participants were excluded color blindness, substance 
abuse, others psychiatry disorders, and severe clinical illness. 
The age, gender, years of education, the duration of schizo- 
phrenia diagnosis from onset to the experiment, and the le- 
ngth of the current hospitalization were showed in Table 1. 
There were no significant differences in age, gender, and years 
of education between patients with schizophrenia and normal 
controls (t=-1.81, p>0.05; X 2 =2.77, p>0.05; t=1.54, p>0.05 re- 
spectively). Institutional Review Board (IRB) approval was ob- 
tained from the ethics committee of Shin- Ann Hospital and 
informed consent were obtained from all participants before 
study. 

Measures 



Aims of the study 

The aims of this study were: 1) to examine the differences in 
visual search performance between patients with schizophre- 



The visual search task 

The visual search task (VST) was used to measure cognition 
function, including feature search task and conjunction search 



Table 1 . Demographic information of patients with schizophrenia and normal controls 



Patients with schizophrenia Normal controls 

(N=14) (N=15) 



Age (years) 


46.36 (SD=6.74) 


40.87 (SD=9.33) 


t=-1.81 


Gender 






X 2 =2.77 


Male 


8 (57.14%) 


4 (26.67%) 




Female 


6 (42.86%) 


11 (73.33%) 




Years of education (years) 


9.43±2.59 


11.07±3.11 


t=1.54 


Duration of disorder (range= 156-360 months) 


235.20±70.93 


N/A 




Length of the current hospitalization (range=l-20 months) 


10.00±4.49 


N/A 
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task. The target stimulus in both tasks was a red square; the dis- 
trainors were red circles in the feature search task and red cir- 
cles and green squares in the conjunction search task (Figure 
1). The experimental material and procedure were followed by 
Tanaka et al. 3 In each task, a set of 4, 16, or 25 items was pre- 
sented, and each task included one practice block of 10 trials 
and three blocks of 30 trials each. 

Total was 100 stimuli for the feature search task and 100 
stimuli for conjunction search task. The red square of target 
was randomly displayed in half of each trial. Reaction times 
(RTs) and the numbers of correct response (accuracy rate) 
were recorded. 

Japanese and Caucasian Facial Expression of Emotion 

Japanese and Caucasian Facial Expression of Emotion (JA- 
CFEE) was used to measure the participants' ability to process 
the facial expression identification. 25,26 There are six different 
emotional expressions, anger, fear, happiness, surprised, dis- 
gusted, and sadness; and each emotion has four pictures. Tw- 
enty-four different faces were randomly presented and the ac- 
curacy rates of each emotion expression were recorded. 

Experimental procedure 

Participants finished VAS first and then JACFEE. This study 
used a 14-inch laptop with Superlab software (Cedurs Corpo- 
ration, San Pedro, CA) for displaying the visual search stimuli. 
Before the visual search of each trial, a fixation point (black 
dot) was presented on the center of the laptop screen, and af- 
ter 900 ms, a stimulus was displayed. The stimulus presented 
for 4 seconds and participants were instructed to respond wh- 
ether the target stimulus was presented and pressed the "Yes" 
or "No" on the keyboard as soon as possible. Participants were 
allowed to rest for approximately one minute between two tri- 
als. It took two-10-min to complete the feature search task and 
then the conjunction search task. The JACFEE was displayed 



for 10 seconds on the computer screen. Participants were asked 
to label the emotion on the multiple choices and record on 
the answer sheet within 20 seconds. 

Data reduction and statistic analysis 

When participant cannot follow the VST procedure in the 
practice block of 10 trials, or RTs shorter than 200 ms or lon- 
ger than 4000 ms, were excluded from data analyses, t-tests 
were used to examine the group differences in RTs and accu- 
racy rate of the VST and accuracy rates of the JACFEE be- 
tween patients with schizophrenia and normal controls. The 
Pearsons correlations were examined between visual search 
and facial expression identification by SPSS 18.0. 

RESULTS 

Group differences in visual search performance and 
facial expression identification 

Regarding visual search performance, the results showed 
that patients with schizophrenia had longer RTs than normal 
controls on feature search (t=5.30, p<0.001) and conjunction 
search (t=6.74, p<0.001). Patients with schizophrenia also 
had lower accuracy rate than normal controls on feature se- 
arch (t=-3.32, p<0.01) and conjunction search (t=-4.42, p< 
0.001). Therefore, patients with schizophrenia had significant- 
ly longer RTs and lower accuracy rate in feature search and 
conjunction search than normal controls (Table 2). 

Regarding facial expression identification, the total accura- 
cy rate of patients with schizophrenia was lower than that of 
normal controls (t=-4.22, p<0.001) (Figure 2). Subscales of fa- 
cial expression identification showed that the accuracy rate of 
patients with schizophrenia were significantly lower than that 
of normal controls on surprised (t=-5.17, p<0.001) and dis- 
gusted (t=-5.33, p<0.001) (Table 2). 
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Figure 1. Example displays of feature se- 
arch (left) and conjunction search (right). 
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Table 2. Reaction time and accuracy rate of visual search and accuracy rate of facial expression identification in patients with schizophre- 
nia and normal controls 



Mean (SD) 


Patients with schizophrenia 


Normal controls 


t 


Reaction time of visual search (ms) 








Feature search 


1732.18 (503.12) 


870.88 (353.71) 


5.30*** 


Conjunction search 


1916.35 (449.31) 


1015.76 (226.57) 


6 y4*** 


Accuracy rate of visual search (%) 








Feature search 


64.52 (33.53) 


96.15 (12.51) 


-3.32** 


Conjunction search 


59.45 (31.01) 


96.37 (3.86) 


-4 42*** 


Accuracy rate of facial expression identification (%) 


47.92 (14.78) 


70.00 (13.29) 


-4.22*** 


Anger 


58.93 (21.05) 


70.00(21.55) 


-1.40 


Fear 


39.29 (33.56) 


33.33 (26.16) 


0.53 


Happiness 


91.07(15.83) 


93.33 (11.44) 


-0.44 


Surprised 


48.21 (31.72) 


93.33(11.44) 


-5 17*** 


Disgusted 


17.86 (22.85) 


71.67 (31.15) 


-5 33*** 


Sadness 


32.14(34.57) 


58.33 (34.93) 


-2.03 


**p<0.01, ***p<0.001 
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Figure 2. Accuracy rates of facial ex- 
pression identification in patients with 
schizophrenia and normal controls. 



Correlations between visual search performance and 
facial expression identification 

For all participants, there were strong positively correla- 
tions between feature search and conjunction search on the 
RTs (r=0.88, p<0.001) and the accuracy rate (r=0.87, p<0.001). 
The RTs and accuracy rate of feature search and conjunction 
search were shown negatively correlations (r=-0.75, p<0.001 
and r=-0.80, p<0.001 respectively) (Table 3). 

The visual search performance was related to the facial ex- 
pression identification. The RTs of feature search and conjunc- 
tion search were negatively correlated with the accuracy rate 



of facial expression identification (r=-0.75, p<0.001 and r= 
-0.70, p<0.001 respectively), and the accuracy rate of feature 
search and conjunction search were positively correlated with 
the accuracy rate of facial expression identification (r=0.60, 
p<0.001 and r=0.66, p<0.001 respectively). 

For patients with schizophrenia, there were negative corre- 
lations between the accuracy rate of facial expression identi- 
fications and RTs of feature search (r=-0.70, p<0.01) and con- 
junction search (r=-0.67, p<0.01), as well as positive correl- 
ation between the accuracy rate of facial expression identific- 
ations and the accuracy rate of conjunction search (r=0.55, 
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p<0.05). Furthermore, regarding subscales of facial expres- 
sion identification, there were negative correlations between 
the accuracy rate of surprised and the RTs of feature search (r= 
-0.75, p<0.01) and conjunction search (r=-0.83, p<0.01), as 
well as negative correlations between the accuracy rate of sad- 
ness and the RTs of feature search (r=-0.60, p<0.05). However, 
there was no significant correlation between the VST and the 
JACFEE scores in normal controls. 

DISCUSSION 

The findings of this study showed that patients with schizo- 
phrenia had worse visual search performance both in feature 
search and conjunction search, as well as worse ability of fa- 
cial expression identification than normal controls. In addi- 
tion, there were associations between visual search perfor- 
mance and facial expression identification in patients with schi- 
zophrenia. 

Patients with schizophrenia had deficits on visual search 
ability that they spent more time on visual search task but ac- 
quired a lower accuracy rate on both visual search tasks. These 
results were partially consistent with previous study 3 that there 
was only a significantly difference between patients with schi- 
zophrenia and normal controls in the conjunction search ra- 
ther than the feature search. However, the patients with schi- 
zophrenia in Tanaka's study were outpatients, but ours were 
inpatients and may have more severe psychotic symptoms 
that might influence the performance of visual search tasks. 

The considering visual search deficit may be explained by 
the feature integration theory. 9 According to the theory, feature 
search represents a preattentive process that separates the basic 
feature in the visual search; however, conjunction search rep- 
resents a focal attention process that discriminates and inte- 
grates the visual search. Elahipanah et al. 12 indicated that the 
perceptual grouping can help individuals to focus attention 
on the stimuli and then discriminate the target and distractors. 
Patients with schizophrenia may suffer difficulty with the per- 
ceptual grouping. 

Patients with schizophrenia also had worse ability to dis- 
criminate and identify facial expression than normal controls, 
especially the emotion of surprised and disgusted. In patients 
with schizophrenia, shorter RTs of feature search and conjunc- 
tion search were related to higher accuracy rates of identify 
the facial expression of surprised and sadness. Batty and Tay- 
lor 27 indicated the relationships between six basic facial emo- 
tional expressions and brain areas. The basal ganglia and in- 
sula was related to disgust faces; the amygdale was linked to 
fearful faces and sad faces; the cingulate sulcus was linked to 
happy faces; the orbital frontal regions was linked to anger 
faces. 27 Wylie and Tregellas 28 indicated that insula related to 
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process both visual and auditory emotional information. 
When patients suffered the insula lesions might experience the 
difficulty in recognizing facial expressions, especially on dis- 
gusted, surprised, fear, anger, and sadness. 28,29 

In addition, there were significant relationships between 
visual search performance and facial expression identification 
only in patients with schizophrenia instead of normal controls. 
The deficits in visual attention or perceptual grouping may 
influence identify that facial expression and interrupt the in- 
terpersonal relationship. The results found that shorter RTs of 
visual search related to higher accuracy rate on facial expres- 
sion identification, as well higher accuracy rate of visual search 
related to higher accuracy rate on facial expression identifica- 
tion. These correlations were most likely shown on surprised 
and sadness. Therefore, underlying information processing 
deficits may relate to the psychopathological mechanisms of 
schizophrenia, 8 particularly in facial identification of surprised 
and sadness. Regarding the clinical implication of this study, 
training patients with schizophrenia concentrated on visual 
search task and facial expression identification may have ben- 
efits on their social function. 

Limitations 

Some limitations of this study should be acknowledged. 
First, the small sample size and the large range of the length of 
current hospitalization may make the results difficult to inter- 
pret and generalize to patients with schizophrenia. Second, vi- 
sual attention may be one of the factors which influenced so- 
cial cognition in schizophrenia, and there are still other factors 
such as intelligence or education. In future study, matched or 
case-control study design, such as controlled the psychiatry 
symptoms, duration of disorder, outpatients or inpatients were 
needed. Furthermore, exploring the pathological anatomy of 
schizophrenia about visual search performance and facial ex- 
pression identification were needed. 
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